Multimodal Content Delivery for Geo-services

This thesis describes a body of work carried out over several research projects in the area of multimodal interaction for location-based services. Research in this area has progressed from using simulated mobile environments to demonstrate the visual modality, to the ubiquitous delivery of rich media using multimodal interfaces (geo- services). To effectively deliver these services, research focused on innovative solutions to real-world problems in a number of disciplines including geo-location, mobile spatial interaction, location-based services, rich media interfaces and auditory user interfaces. My original contributions to knowledge are made in the areas of multimodal interaction underpinned by advances in geo-location technology and supported by the proliferation of mobile device technology into modern life. Accurate positioning is a known problem for location-based services, contributions in the area of mobile positioning demonstrate a hybrid positioning technology for mobile devices that uses terrestrial beacons to trilaterate position. Information overload is an active concern for location-based applications that struggle to manage large amounts of data, contributions in the area of egocentric visibility that filter data based on field-of-view demonstrate novel forms of multimodal input. One of the more pertinent characteristics of these applications is the delivery or output modality employed (auditory, visual or tactile). Further contributions in the area of multimodal content delivery are made, where multiple modalities are used to deliver information using graphical user interfaces, tactile interfaces and more notably auditory user interfaces. It is demonstrated how a combination of these interfaces can be used to synergistically deliver context sensitive rich media to users - in a responsive way - based on usage scenarios that consider the affordance of the device, the geographical position and bearing of the device and also the location of the device

A Framework for Processing Viewer-based Directional Queries in a Simulated Mobile Environment

With the steady and fast advancements in the integration of geographic information systems and mobile location-based services, interest in exploiting this technology for Cultural Heritage (CH) data sharing has become apparent. In this area there has been an increasing need to integrate positional information with non-positional data and add a spatial dimension to the definition of a users “context” In this research the integration of Cultural Heritage information coupled with spatial technologies is investigated. The idea is based on a 3-tier architecture that positions the user at the client layer with a mobile device, a spatial query processor in the middle layer and a Cultural Heritage dataset layer. This novel idea applied in this context is the basis for this study. The research aims to develop a framework that enables the simulation of a mobile environment in which spatial applications can be implemented and evaluated without the current restriction of mobile bandwidth in the context of availability and operational costs. The prototype system is demonstrated using a spatial application that processes user-based directional queries. The application gathers information about the position and orientation/direction of the user in a 3D environment. These parameters are evaluated along with the users profile and preferences and a user-based query is formulated. The query is processed using an Oracle spatial engine and the user-tailored results are delivered to the mobile device. Finally, an experimental implementation shows how the query processor performs within a VRML model of Dublin linked to a spatially enabled CH dataset

3DQ: Threat Dome Visibility Querying on Mobile Devices

3DQ (Three Dimensional Query) is our mobile spatial interaction (MSI) prototype for location and orientation aware mobile devices (i.e. today\u27s sensor enabled smartphones). The prototype tailors a military style threat dome query calculation using MSI with hidden query removal functionality for reducing “information overload” on these off-the-shelf devices. The effect gives a more accurate and expected query result for Location-Based Services (LBS) applications by returning information on only those objects visible within a user’s 3D field-of-view. Our standardised XML based request/response design enables any mobile device, regardless of operating system and/or programming language, to access the 3DQ web-service interfaces

EgoViz – a Mobile Based Spatial Interaction System

This paper describes research carried out in the area of mobile spatial interaction and the development of a mobile (i.e. on-device) version of a simulated web-based 2D directional query processor. The TellMe application integrates location (from GPS, GSM, WiFi) and orientation (from digital compass/tilt sensors) sensing technologies into an enhanced spatial query processing module capable of exploiting a mobile device’s position and orientation for querying real-world 3D spatial datasets. This paper outlines the technique used to combine these technologies and the architecture needed to deploy them on a sensor enabled smartphone (i.e. Nokia 6210 Navigator). With all these sensor technologies now available on one device, it is possible to employ a personal query system that can work effectively in any environment using location and orientation as primary parameters for directional queries. In doing so, novel approaches for determining a user’s query space in 3 dimensions based on line-of-sight and 3D visibility (ego-visibility) are also investigated. The result is a mobile application that is location, direction and orientation aware and using these data is able to identify objects (e.g. buildings, points-of-interest, etc.) by pointing at them or when they are in a specified field-of-view

Atmospheric observations of the water vapour continuum in the near-infrared windows between 2500 and 6600 cm-1

Water vapour continuum absorption is potentially important for both closure of the Earth's energy budget and remote sensing applications. Currently, there are significant uncertainties in its characteristics in the near-infrared atmospheric windows at 2.1 and 1.6 µm. There have been several attempts to measure the continuum in the laboratory; not only are there significant differences amongst these measurements, but there are also difficulties in extrapolating the laboratory data taken at room temperature and above to temperatures more widely relevant to the atmosphere. Validation is therefore required using field observations of the real atmosphere. There are currently no published observations in atmospheric conditions with enough water vapour to detect a continuum signal within these windows or where the self-continuum component is significant. We present observations of the near-infrared water vapour continuum from Camborne, UK, at sea level using a Sun-pointing, radiometrically calibrated Fourier transform spectrometer in the window regions between 2000 and 10 000 cm−1. Analysis of these data is challenging, particularly because of the need to remove aerosol extinction and the large uncertainties associated with such field measurements. Nevertheless, we present data that are consistent with recent laboratory datasets in the 4 and 2.1 µm windows (when extrapolated to atmospheric temperatures). These results indicate that the most recent revision (3.2) of the MT_CKD foreign continuum, versions of which are widely used in atmospheric radiation models, requires strengthening by a factor of ∼5 in the centre of the 2.1 µm window. In the higher-wavenumber window at 1.6 µm, our estimated self- and foreign-continua are significantly stronger than MT_CKD. The possible contribution of the self- and foreign-continua to our derived total continuum optical depth is estimated by using laboratory or MT_CKD values of one, to estimate the other. The obtained self-continuum shows some consistency with temperature-extrapolated laboratory data in the centres of the 4 and 2.1 µm windows. The 1.6 µm region is more sensitive to atmospheric aerosol and continuum retrievals and therefore more uncertain than the more robust results at 2.1 and 4 µm. We highlight the difficulties in observing the atmospheric continuum and make the case for additional measurements in both the laboratory and field and discuss the requirements for any future field campaign

Towards a Conceptual Framework for the Development of Immersive Experiences to Negotiate Meaning and Identify in Irish Language Learning

The onset of virtual reality systems allows for new immersive content which provides users with a sense of presence in their virtual environment. This paper provides the conceptual framework for a larger study examining how designed virtual reality experiences can be utilised to transform Irish language meaning making and a user\u27s personal Irish language identity

A Web and Mobile System for Environmental Decision Support

Current field data collection methods for many of today’s scientific and other observer/monitor type applications are still entrenched in the “clipboard age”, requiring manual data transcription to a database management system at some (often much) later date, and only allows for visualisation and analysis of recently captured field data “back in the lab”. This chapter is targeted at progressing today’s pen & paper methodology into the spatially enabled mobile computing age of realtime multi-media data input, integration, visualisation, and analysis simultaneously both in the field and the lab. The system described is customized to the specific needs of the Canadian Great Lakes Laboratory for Fisheries and Aquatic Sciences Fish Habitat Management Group requirements for fish species at risk assessment, but is ready for adaptation to other environmental agency applications (e.g. forestry, health-pesticide monitoring, agriculture, etc.). The chapter is ideally suited to all agencies responsible for collecting field data of any type that have not yet moved to a state-of-the-art mobile and wireless data collection, visualisation, and analysis work methodolog

A Web-based and Mobile Environmental Management System

This paper describes a Web-based and mobile system specifically developed to monitor fish species at risk. Such a system integrates spatial functionality to allow users not only to visualise maps and metadata of the area of concern but also to perform context-aware queries and updating of spatial datasets. The spatial datasets are provided by the Canadian Department of Fisheries and Oceans (DFO) and the prototype is customised to the specific needs of the Great Lakes Laboratory for Fisheries and Aquatic Sciences (GLLFAS) Fish Habitat Section requirements for fish species at risk assessment. Currently, researchers, habitat biologists and enforcement officers have access to the fisheries database, containing layers of biological information solely from the office. Delivering these data overlaid on base maps of the Great Lakes region to a GPS-enabled hand-held device and linking it to each task currently being investigated allows for mobile DFO biologists and enforcement officers in the field to make informed decisions immediately. In this paper we describe the system and demonstrate how it is used by the DFO in practice

Can measurements of the near-infrared solar spectral irradiance be reconciled? A new ground-based assessment between 4000-10000 cm-1

The near-infrared solar spectral irradiance (SSI) is of vital importance for understanding the Earth’s radiation budget, and in Earth observation applications. Differences between previously published solar spectra (including the commonly-used ATLAS3 spectrum) reach up to 10% at the low-wavenumber end of the 4000-10000 cm-1 (2.5 – 1 μm) spectral region. The implications for the atmospheric sciences are significant, since this spectral region contains 25% of the incoming total solar irradiance. This work details an updated analysis of the CAVIAR SSI, featuring additional analysis techniques and an updated uncertainty budget using a Monte Carlo method. We report good consistency with ATLAS3 in the 7000-10000 cm-1 region where there is confidence in these results due to agreement with other spectra, but ~7% lower in the 4000-7000 cm-1 region, in general agreement with several other analyses